Lost in the pandemic: COVID-19's impact on health professions educators.

BACKGROUND: Minimal research has explored the pandemic's impact on health professions educators (HPEs). Given that health professions educator academies provide centralised support and professional development to HPEs through communities of practice and promoting education at their institutions, it is important to examine how academies met HPEs' needs during the pandemic. This study investigates the COVID-19 pandemic's effects on HPEs and examines how academies supported HPEs' educational roles during the pandemic. METHODS: Using a mixed-methods approach, the authors surveyed United States educator academy members on changes in HPEs' activities, emphasising clinical and educational tasks and work-life integration. Participants shared their academies' innovations and support responses. Data were analysed using chi-square and content analyses. FINDINGS: Twenty percent of 2784 recipients (n = 559) completed the survey. Most respondents indicated the pandemic caused them to spend more time on clinical and education leadership/administration than before the pandemic. HPEs integrated innovative instructional strategies, yet many shifted away from teaching, mentoring and scholarship. Over half were dissatisfied with work-life integration during the pandemic. Females, especially, reported that professional work was compromised by personal caregiving. Academies increased their range of member services; however, they did not fully meet their members' needs, including providing expanded professional development and advocating on HPE's behalf for increased protected time dedicated to educator responsibilities. DISCUSSION: HPEs faced unprecedented challenges in their personal and professional lives during the COVID-19 pandemic. Neglecting the needs of HPEs amidst global crises poses a substantial threat to the quality of education for upcoming generations of health care professionals.

A Pilot Survey on the Perceptions of Pediatric Subspecialty Fellows and Program Directors on Virtual Compared with In-Person Interview Experiences.

Pediatric fellowship programs have conducted virtual interviews since the start of the COVID-19 pandemic in 2020. In this national survey of fellowship program directors and fellows interviewed in-person and virtually, fellowship program directors and fellows formed accurate impressions, regardless of format, but our data did not clearly support one interview format over another.

Embedding Interprofessional Education in Clinical Settings: Medical and Dental Student Perceptions of a Patient Interview-Storytelling Experience.

PROBLEM: Interprofessional education (IPE) is valued but difficult to deliver, given logistical and other barriers. Centering IPE around patients and grounding it in authentic practice settings are challenging within early undergraduate medical education. APPROACH: This intervention facilitated student-patient conversations to elicit patient reflections on the health care professionals who keep them healthy and care for them when they are unwell. After being introduced to the Interprofessional Education Collaborative (IPEC) core competencies, first-year medical (n = 127) and dental (n = 34) students conducted a brief semistructured patient interview, using an interview card with guiding questions, during a precepted outpatient clinic session in March-May 2021. Students transcribed patients' stories and wrote their own reflections on the interview card. These reflections were used as a stimulus for a class IPE discussion. The authors employed a pragmatic qualitative research approach to explore what students learned about interprofessional collaboration from reflecting on patients' stories. OUTCOMES: Of the 161 students, 158 (98%) completed an interview card. Sixteen health professions were represented in patients' stories. The patients' stories prompted students to recognize and expand their understanding of the IPEC competencies. Students' responses reflected synthesis of the competencies into 3 themes: students value patient-centered holistic care as the goal of interprofessional collaboration; students reflect emerging professional and interprofessional identities in relating to patients, teams, and systems; and students appreciate interprofessional care is complex and challenging, requiring sustained effort and commitment. NEXT STEPS: Next steps include continuing to integrate patient voices through structured conversations across the undergraduate and graduate medical education spectrum and adapting the model to support conversations with other health professionals engaged in shared patient care. These experiences could foster ongoing deliberate reflection by students on their professional and interprofessional identity development but would require investments in student time and faculty development.

Relationship between epa level of supervision with their associated subcompetency milestone levels in pediatric fellow assessment.

BACKGROUND: Entrustable Professional Activities (EPA) and competencies represent components of a competency-based education framework. EPAs are assessed based on the level of supervision (LOS) necessary to perform the activity safely and effectively. The broad competencies, broken down into narrower subcompetencies, are assessed using milestones, observable behaviors of one's abilities along a developmental spectrum. Integration of the two methods, accomplished by mapping the most relevant subcompetencies to each EPA, may provide a cross check between the two forms of assessment and uncover those subcompetencies that have the greatest influence on the EPA assessment. OBJECTIVES: We hypothesized that 1) there would be a strong correlation between EPA LOS ratings with the milestone levels for the subcompetencies mapped to the EPA; 2) some subcompetencies would be more critical in determining entrustment decisions than others, and 3) the correlation would be weaker if the analysis included only milestones reported to the Accreditation Council for Graduate Medical Education (ACGME). METHODS: In fall 2014 and spring 2015, the Subspecialty Pediatrics Investigator Network asked Clinical Competency Committees to assign milestone levels to each trainee enrolled in a pediatric fellowship for all subcompetencies mapped to 6 Common Pediatric Subspecialty EPAs as well as provide a rating for each EPA based upon a 5-point LOS scale. RESULTS: One-thousand forty fellows were assessed in fall and 1048 in spring, representing about 27% of all fellows. For each EPA and in both periods, the average milestone level was highly correlated with LOS (rho range 0.59-0.74; p < 0.001). Correlations were similar when using a weighted versus unweighted milestone score or using only the ACGME reported milestones (p > 0.05). CONCLUSIONS: We found a strong relationship between milestone level and EPA LOS rating but no difference if the subcompetencies were weighted, or if only milestones reported to the ACGME were used. Our results suggest that representative behaviors needed to effectively perform the EPA, such as key subcompetencies and milestones, allow for future language adaptations while still supporting the current model of assessment. In addition, these data provide additional validity evidence for using these complementary tools in building a program of assessment.

Evaluation of Housing Affordability Among US Resident Physicians.

This cross-sectional study evaluates the extent of housing unaffordability among US residency programs.

Perceptions of the stressful job search for pediatric hematology/oncology fellows.

The pediatric hematology and oncology (PHO) workforce landscape has been evolving over the past decades, with concern for waning interest in the subspecialty. We aimed to evaluate the impact of the initial PHO job search on fellow stress and anxiety, in addition to perceptions of the job search experience and potential areas of improvement. An anonymous survey consisting of demographics, emotional health impacts such as stress and anxiety, and job search experiences was developed and distributed to program leadership at all 74 PHO fellowship programs. At least one representative from 49 (66%) programs responded. Faculty were less likely than fellows to perceive that fellows are struggling to find jobs (p = .0198). However, faculty were more likely than fellows to perceive that fellows are either "extremely stressed" or "stressed" due to job search (p = .0003). By June 2021, 30 of 44 (68%) candidates had been offered a position, and 80% of those had accepted. There were no significant associations between fellow stress level and job offering, proximity to their ideal goals, or change in career type. Common barriers to the job search included geographic constraints and partner employment. Respondents identified centralized job listings, formal training on career development strategies, introduction to various career paths, and more transparency about the search as needed interventions. The perception of difficulty and stress regarding the job search is endorsed by most, identifying a need for more interventions to improve the experience. These data also highlight unmet mentorship and educational needs among PHO fellows in preparing for the job search.

Provider and staff crisis well-being associated with trust in leadership and baseline burnout.

BACKGROUND: The impact of the coronavirus 2019 (COVID-19) pandemic on the emotional health of health care workers continues to be an area of active research. However, few studies have focused on those working in pediatrics and its subspecialties, as well as ancillary and non-patient-facing staff. The purpose of this study was to determine the prevalence and associated predictors of burnout and emotional well-being of providers and staff. METHODS: An anonymous electronic survey was developed evaluating demographics, pandemic experiences, possible predictor variables, and three main outcomes of burnout, psychological distress, and perceived stress. Pediatric hematology oncology (PHO) chiefs and program directors across the country were invited to participate and disseminate the survey to their programs. RESULTS: A total of 682/1950 (35% of invited) individuals responded to all predictor and outcome variables. Over half reported high levels of burnout and some reported moderate/high levels of distress. Prepandemic burnout and decreased trust in leadership were associated with all three outcomes. Additional predictors included having a child ≤18 years at home, hospital role, and worrying about patient care or relationship with their patients. The majority (n = 444/682, 65.5%) reported that their institution had made COVID-19-related mental health resources available. However, only 6.5% (n = 44/682) reported utilizing these resources. CONCLUSIONS: While the majority of PHO providers and staff were resilient during the early stages of the COVID-19 pandemic, many reported high levels of burnout, yet few are utilizing institutional resources. This study has highlighted several actionable areas to help identify and address factors that are wearing down the emotional well-being of providers and staff.

Implementation of competence by design in Canadian neurosurgery residency programs.

OBJECTIVE: The Royal College of Physicians and Surgeons of Canada (RCPSC) recently redesigned the Canadian neurosurgery residency training curriculum by implementing a competency-based model of training known as Competence by Design (CBD) centered around the assessment of Entrustable Professional Activities (EPAs). This sequential explanatory mixed-methods study evaluated potential benefits and pitfalls of CBD in Canadian neurosurgery residency education. METHODS: Two four-month interval surveys were distributed to all Canadian neurosurgery residents participating in CBD. The surveys assessed important educational components: CBD knowledge of key stakeholders, potential system barriers, and educational/psychological impacts on residents. Paired t-tests were done to assess changes over time. Based on longitudinal survey responses, semi-structured interviews were conducted to investigate in-depth residents' experience with CBD in neurosurgery. The qualitative analysis followed an explanatory approach, and a thematic analysis was performed. RESULTS: Surveys had 82% average response rate (n = 25). Over time, most residents self-reported that they retrospectively understood concepts around CBD intentions (p = 0.02). Perceived benefits included faculty evaluations with more feedback that was clearer and more objective (53% and 51%). Pitfalls included the amount of time needed to navigate through EPAs (90%) and residents forgetting to initiate EPA forms (71%). There was no significant change over time. During interviews, five key themes were found. Potential solutions identified by residents to enhance their experience included learning analytics data availability, mobile app refinement, and dedicated time to integrate EPAs in the workflow. CONCLUSION: This study was the first to assess resident-perceived benefits and pitfalls of the neurosurgery CBD training program in an educational framework context. In general, residents believed that theoretical principles behind CBD were valuable, but that technological ability and having enough time to request EPA assessments were significant barriers to success. Long-term studies are required to determine the definitive outcomes of CBD on residents' performance and ultimately, on patient care.

Leveraging Podcasts to Introduce Medical Students to the Broader Community of Health Care Professionals.

INTRODUCTION: Safe, patient-centered, and cost-effective care requires effective collaboration within interprofessional teams. Education programs for health care professionals are often siloed, providing students with limited interprofessional education (IPE) opportunities to learn from, with, and about other professions. Podcasts offer a novel approach to facilitate IPE, allowing for asynchronous conversations with interprofessional colleagues. METHODS: We developed four podcasts with various health care professionals for 135 preclinical medical students preparing to transition into clinical rotations. The podcasts were coupled with an hour-long interactive session with the podcast interviewees conducted via videoconference. The curriculum explored the distinct education paths, roles, and responsibilities of various health care disciplines. Strategies for communicating effectively with and learning from interprofessional team members were emphasized. RESULTS: There were 197 unique downloads of the podcasts, and 95 students attended the interactive session. Most students reported that the podcasts and follow-up live session enhanced their learning (100% and 98% of students who completed the postcurriculum survey, respectively). Responses to the postcurriculum survey revealed students learned strategies for engaging in productive interprofessional conversations, the importance of leveraging the distinct roles and responsibilities of diverse health professionals, the value of learning from other health professionals, and the use of respectful language. DISCUSSION: This IPE curriculum built around podcasts enhances medical student learning and represents an innovative approach to improving access to IPE in a virtual learning environment. This modality can be adapted to meet the needs of a wide spectrum of learners and can be coupled with in-person learning.

Achieving Entrustable Professional Activities During Fellowship.

BACKGROUND AND OBJECTIVES: Entrustable Professional Activities (EPAs) were developed to assess pediatric fellows. We previously showed that fellowship program directors (FPDs) may graduate fellows who still require supervision. How this compares with their expectations for entrustment of practicing subspecialists is unknown. METHODS: We surveyed US FPDs in 14 pediatric subspecialties through the Subspecialty Pediatrics Investigator Network between April and August 2017. For each of 7 common pediatric subspecialty EPAs, we compared the minimum level of supervision that FPDs required for graduation with the level they expected of subspecialists for safe and effective practice using the Friedman rank sum test and paired t test. We compared differences between subspecialties using linear regression. RESULTS: We collected data from 660 FPDs (response rate 82%). For all EPAs, FPDs did not require fellows to reach the level of entrustment for graduation that they expected of subspecialists to practice (P < .001). FPDs expected the least amount of supervision for the EPAs consultation and handovers. Mean differences between supervision levels for graduation and practice were smaller for clinical EPAs (consultation, handovers, lead a team) when compared with nonclinical EPAs (quality improvement, management, lead the profession and scholarship; P = .001) and were similar across nearly all subspecialties. CONCLUSIONS: Fellowship graduates may need continued development of clinical and nonclinical skills in their early practice period, underscoring a need for continued assessment and mentoring. Graduation readiness must be based on clear requirements, with alignment of FPD expectations and regulatory standards, to ensure quality care for patients.

Continued Supervision for the Common Pediatric Subspecialty Entrustable Professional Activities May Be Needed Following Fellowship Graduation.

PURPOSE: Entrustable professional activities (EPAs) are one approach to competency-based medical education (CBME), and 7 EPAs have been developed that address content relevant for all pediatric subspecialties. However, it is not known what level of supervision fellowship program directors (FPDs) deem necessary for graduation. The Subspecialty Pediatrics Investigator Network (SPIN) investigated FPD perceptions of the minimum level of supervision required for a trainee to successfully graduate. METHOD: In 2017, SPIN surveyed all FPDs of accredited fellowships for 14 subspecialties. For each EPA, the minimum supervision level for graduation (ranging from observation only to unsupervised practice) was set such that no more than 20% of FPDs would accept a lower level. RESULTS: The survey response rate was 82% (660/802). The minimum supervision level for graduation varied across the 7 EPAs from 2 (direct) to 4 (indirect for complex cases), with significant differences between EPAs. The percentage of FPDs desiring a lower minimum supervision level ranged from 3% to 17%. Compared with the 4 nonclinical EPAs (quality improvement, management, lead within the profession, scholarship), the 3 clinical EPAs (consultation, handover, lead a team) had higher minimum supervision graduation levels (P < .001), with less likelihood that an FPD would graduate a learner below their minimum level (P < .001). CONCLUSIONS: Consensus among FPDs across all pediatric subspecialties demonstrates the potential need for ongoing supervision for graduates in all 7 common pediatric subspecialty EPAs after fellowship. As CBME programs are implemented, processes and infrastructure to support new graduates are important considerations for leaders.

The COVID-19 Online Learning Transition and the Plus/Delta Debriefing Model.

ABSTRACT: As a result of the COVID-19 pandemic, the Harvard Medical School Master of Medical Sciences in Medical Education program implemented the Plus/Delta debriefing model to collect real-time learner feedback and facilitate continuous quality improvement within our assessment and program evaluation module, which rapidly transitioned online. The model is grounded in quality improvement methodology and encourages bidirectional rather than top-down feedback. Learners identified specifically what went well with each module session (Plus) and how to improve for the next time (Delta). After each session, narrative responses were reviewed, aggregated into meaningful categories, and implemented when possible. Implemented improvements focused on increasing session interactivity and enhancing communication. Learners pointed to the uniqueness of the model and applauded efforts to embed them in the cocreation process. Asking learners to debrief their experience-especially during a module which is iteratively redesigned week-by-week-can offer a realistic view of what is working and what needs further refinement. As we continue to navigate the COVID-19 pandemic, rapid, continuous educational quality improvement deserves renewed emphasis. Implementing the Plus/Delta debriefing model into longitudinal online teaching sessions is a translatable, easily replicable, and free method of receiving immediate and valuable learner feedback.

Pediatric Trainees' Speaking Up About Unprofessional Behavior and Traditional Patient Safety Threats.

OBJECTIVE: Speaking up is increasingly recognized as essential for patient safety. We aimed to determine pediatric trainees' experiences, attitudes, and anticipated behaviors with speaking up about safety threats including unprofessional behavior. METHODS: Anonymous, cross-sectional survey of 512 pediatric trainees at 2 large US academic children's hospitals that queried experiences, attitudes, barriers and facilitators, and vignette responses for unprofessional behavior and traditional safety threats. RESULTS: Responding trainees (223 of 512, 44%) more commonly observed unprofessional behavior than traditional safety threats (57%, 127 of 223 vs 34%, 75 of 223; P < .001), but reported speaking up about unprofessional behavior less commonly (48%, 27 of 56 vs 79%, 44 of 56; P < .001). Respondents reported feeling less safe speaking up about unprofessional behavior than patient safety concerns (52%, 117 of 223 vs 78%, 173 of 223; P < .001). Respondents were significantly less likely to speaking up to, and use assertive language with, an attending physician in the unprofessional behavior vignette than the traditional safety vignette (10%, 22 of 223 vs 64%, 143 of 223, P < .001 and 12%, 27 of 223 vs 57%, 128 of 223, P < .001, respectively); these differences persisted even among respondents that perceived high potential for patient harm in both vignettes (20%, 16 of 81 vs 69%, 56 of 81, P < .001 and 20%, 16 of 81 vs 69%, 56 of 81, P < .001, respectively). Fear of conflict was the predominant barrier to speaking up about unprofessional behavior and more commonly endorsed for unprofessional behavior than traditional safety threats (67%, 150 of 223 vs 45%, 100 of 223, P < .001). CONCLUSIONS: Findings suggest pediatric trainee reluctance to speak up when presented with unprofessional behavior compared to traditional safety threats and highlight a need to improve elements of the clinical learning environment to support speaking up.

Establishing trust within interprofessional teams with a novel simulation activity in the pediatric clerkship.

Interprofessional trust is essential for effective team-based care. Medical students are transient members of clinical teams during clerkship rotations and there may be limited focus on developing competency in interprofessional collaboration. Within a pediatric clerkship rotation, we developed a novel simulation activity involving an interprofessional conflict, aiming to foster trusting interprofessional relationships. Active participants included a nurse educator and a medical student participant, with additional students using a checklist to actively observe. The debrief focused on teaching points related to interprofessional competencies and conflict resolution. Students completed a written evaluation immediately following the simulation. Descriptive statistics were used to analyze Likert-type scale questions. Conventional content analysis was used to analyze open-ended responses. Two hundred and fourteen students participated in the simulation between June 2018-June 2019. Most students indicated that the simulation was effective (86%) and improved their confidence to constructively manage disagreements about patient care (88%). Students described anticipated changes in practice including developing their role on the interprofessional team as a medical student, developing a shared mental model, and establishing a shared goal. Our findings suggest that simulation-based learning may present an opportunity for developing interprofessional trust in academic health centers.

Agreement of Program Directors With Clinical Competency Committees for Fellow Entrustment.

OBJECTIVES: Fellowship program directors (FPD) and Clinical Competency Committees (CCCs) both assess fellow performance. We examined the association of entrustment levels determined by the FPD with those of the CCC for 6 common pediatric subspecialty entrustable professional activities (EPAs), hypothesizing there would be strong correlation and minimal bias between these raters. METHODS: The FPDs and CCCs separately assigned a level of supervision to each of their fellows for 6 common pediatric subspecialty EPAs. For each EPA, we determined the correlation between FPD and CCC assessments and calculated bias as CCC minus FPD values for when the FPD was or was not a member of the CCC. In addition, we examined the effect of program size, FPD understanding of EPAs, and subspecialty on the correlations. Data were obtained in fall 2014 and spring 2015. RESULTS: A total of 1040 fellows were assessed in the fall and 1048 in the spring. In both periods and for each EPA, there was a strong correlation between FPD and CCC supervision levels (P < .001). The correlation was somewhat lower when the FPD was not a CCC member (P < .001). Overall bias in both periods was small. CONCLUSIONS: The correlation between FPD and CCC assignment of EPA supervision levels is strong. Although slightly weaker when the FPD is not a CCC member, bias is small, so this is likely unimportant in determining fellow entrustment level. The similar performance ratings of FPDs and CCCs support the validity argument for EPAs as competency-based assessment tools.

Humanism and professionalism training for pediatric hematology-oncology fellows: Results of a multicenter randomized trial.

PURPOSE: Although humanism and professionalism are central tenets to the practice of medicine, few formal curricula exist for medical trainees. Following a national needs assessment among pediatric hematology-oncology (PHO) fellows, we created a novel curriculum entitled "Humanism and Professionalism for Pediatric Hematology-Oncology" (HP-PHO). In this study, we measure outcomes of this curricular intervention. METHOD: We cluster-randomized 20 PHO fellowship programs to deliver usual training in humanism and professionalism (UT) or the novel curriculum (intervention) during the 2016-2017 academic year. The primary outcome measure was the Pediatric Hematology-Oncology Self-Assessment in Humanism (PHOSAH). Secondary measures included the Maslach Burnout Inventory, Patient-Provider Orientation Scale, Empowerment at Work Scale, and a 5-point satisfaction scale. Participating fellows completed pre- and posttests at the beginning and end of the academic year, respectively, and we calculated change scores for each study instrument. RESULTS: Cluster randomization yielded 59 intervention and 41 UT fellows. The nine intervention sites administered 33 of 36 modules. Change scores on the PHOSAH were not significantly different between the UT and intervention arms. However, fellows on the intervention arm gave significantly higher ratings on several items within the satisfaction scale related to physician burnout, physician depression, balancing professional duties and personal life, and humanism overall. CONCLUSIONS: Exposure to the HP-PHO curriculum did not alter fellows' self-assessed humanism and professionalism skills. However, intervention fellows expressed significantly higher levels of satisfaction in their humanism training, indicating the curriculum's potential for positive impact on the fellows' perceived learning environment.

Burnout in pediatric hematology oncology fellows: Results of a cross-sectional survey.

Burnout is a significant problem in the medical community, including among pediatric hematology/oncology (PHO) faculty. However, the prevalence of burnout, its associated risk factors, and outcomes within PHO fellows are unknown. We present the results of a cross-sectional study of PHO fellows from 21 training programs. A total of 45/115 fellows (39.1%) met criteria for high level of burnout. Fellows who met criteria for high burnout also demonstrated poor outcomes including decreased empowerment, increased doctor-centered care, decreased self-assessed humanism, and decreased satisfaction with training. Further longitudinal investigation is needed to better understand burnout and the causative factors affecting PHO fellows.